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ABST^RACT . . 

, > "^be Comprehensive School Mathematics Program" (CSMP) 
IS a program of CEMREL, Inc., one of the national educational 
laboratories,!, and was funded by the Nat i on.ai'' Inst ituJbe of Education 
(NIE). Its major purpose is the development of curriculum materials 
for kindergarten through grade 6. This document. is an extension of 
"Evaluation Report 7-B-4," which looked at revised Mathematics 
Applied to Novel Situations (MANS) tests. This material discusses 
MANS tests that underwit further revisions, viewed as minor and 
within the original purpose of making the tests easier for local 
districts to use. It is felt this primary objective was met, while a 
secondary goal of improving technical qualities of individual scales 
was only partially realized.^ These revised tests were used with 20 
CSMP and 2"0 non-CSMP classes. Results of testing were found to not be 
quite so strongly in favor of the program as in ptevious evaluations, 
but on the total scales CSMP classes averaged 10 percent higher, a 
difference significant at the .05 level. While a difference favoring. 
CSMP was found on each of seven categories, only on the scale for 
number patterns and relationships was there a'statistically 
significant advantage for CSMP pupils. (MP) 
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Description of Evaluation Report Series 

The Comprehensive School Mathematics Program (CSMP) is a program of CEMREL, 
Inc, one of the national educational laboratories and- is funded by the National 
Institute of Educaticn. Its major purpose is the development of curriculum 
matgmls for grades K-6. 

Beginning in September, 1973, CSMP materials began being used in classrooms 
on a regular basis, beginning ip kindergarten and first grade. The evaluation 
activities have paralleled the developfnent and dissemination of materials so that ^ 
the primary evaluation emphasis is now at the upper elementary grades. All t 
activities have been conducted by a group within' CEMREL which is independeTvtf of 
CSMP. ^ ^5 

Tjje evaluation of th'e program in this extended pilot trial is intended to^be 
reasonably comprehensive and to supply infonmation desired by a wide variety of** 
audiences. For that reason the reports in this series are reasonably non-tfichnical ■ 
and do not attempt to widely explore some of the .relatedN'ssues. On the nexl page 
IS given a list of reports through 1980. Below is given a list of reports completed 
in 1981: t i v 

• * 

Evaluation Report: '8-6-1 Sixth Grade Evaluation, PreTiminary Study 

8-B-2 Evaluation of Revised Second Grade, MANS Blue Level 
8-B-3 Evaluation of Revised Third Grade, M/tN§ Green Le.vel 
8-B-4 Three Evaluations of Gifted Student Os( 
' 8-C-l Preliminary Study of CSMP "Graduates"'' 
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Evaluation Report 2-A-il 
(1975) ■ 2-B-l 
. - 2-8^2 
2-B-3 
2-C-l 
2-C-2 

- ' 2-C-3 

Evaluation Report 3-B-l 
.(1976) 3-C-r 



Evaluation Report 
■ (1977) ' 



4-A-l 
4-B-l 
4-B-2 
4-B-3 
4-C-l 



Evaluation Report 5-B-l 
(1978) 5-B-2 
5-C~l 

Evaluation Report 6-B-l 




Extended Pilot Trials of the . . ^ • 

Comprehensl^ve- School Mathe1nat1cs Program 

Evaluation Report Series 

Overview, Design tind Instryinentatlon 
External Review of CSMP Materials 
Final Summary Report Year 1 
^Mi^^Year'Test Data: CSMP First Grade Content • 
End-of-^Year Test Data: CSMP First Grade Content 
End-of-Year Test Data: Standard First Grade Content 
End-of-Year Test Data: CSMP Kindergarten' Content 
Test Data on Some General Cognitive Skills \ 
Summary Test Data: Detroit Schools ; 
Teacher Training Report 
Observations of CSMP First Grade Classes 
Mid-Year Data from Teacher Questionnairies , 
End-of-Year Data from Teacher Questionnaires 
^pterviews wTth CSMP Kindergarten Teachers 
Analysis of Teacher Logs 

Final Summary Report Year 2*- ^ 
Second Grade Test Data 
Readmini strati on of First Grade Tsst Items 
Student Interviews • , " , 

Teacher Questionnaire Data 
Teacher Interviews, Second Grade 
Teacher Interviews, Tirst Grade 

Second and -Third Grade Test Data Year- 3 
Teacher Questionnaire Data Year 3 

Firfal Summary Report Year 4- 
Standaii^dtgfid Test Data, Third Grade 
Mathematics Applied to Novel Situations (MANS) Test Data 
Indl v1duat)ly Administered Problems, Jrtlrd Grade 
Teacher Questionnaire Di»tta, Third Grade 
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Fourth Grade MANS Test Data 
Individually Administered Problem^, 
Teacher Questionnaire. and Interview 



Fourth Grade 
Data, Fourth Grade 



Comparative Test Data: Fourth Grade 
Preliminary Test Data: Fifth Grade 
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Key to Indexing 

Evaluation Reports 'are 1 felled m-X-n,* 

where m is the year of 'the pilot, study, with 1973-74 as Year K 

X is the type of data being reported where A is for overviews • 

and summaries, B is fo:r student outcomes and C is for other data, 
n is^ the number within a given year and type of data. 
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Summary 



This report is an extension of Evaluation Report 7-B-4, Re-evaluation of y/ 
Second Grade, Revised MANS Tests . The revised second grade MANS tesbs (called the 
Blue Level) were further revised after^ their initial use in 1980. The revisions 
were minor and still within the original purpos.e: to make the tests easier 
•for local districts to use. In the Sprirtg of 1981 the revised Blue Level 
MANS tests were administered to 20 CSMP' and'zo non-CSMP classes. The classes came 
from five rather distinctly different school dist rivets, but the majority were 
composed of lower ability students. 

The primary objective of the further revision of the MANS Blue Level was 
judged to have been met: school districts are able to use the tests with e^entially 
no problems. A secondary objective was to improve the technical quality of the 
individual scales. For some scales this objective was met, for otheVs it was not. 

The CSMP/non-CSMP results of the testing were not quite so strongly in favor 
of OSMP as they had been in 1980. - Nevertheless, on the tj^tal of the MANS scales, 
CSMP classes averaged over 10% higher scores than non-CSMP, a difference that 
was significant at the .05 level. In-each of the scale categories, the' CSMP 
classes outscored the non-CSMP classes, the difference 'being statistically 
significant in one of them: Number Patterns and Relationships. 



Introduction 



The Comprehensive School Mathematics Program (CSMP) is a K-6 mathemati^rs 
curriculum being developed and field tested by CEMREL, Inc. During the past 
few years, a special series of MANS Tests (Mathemaiics Applied to Nov^l Situations) 
has been developed for use in the evaluation of CSMP. 

I 

A series of 10 MANS- scales was originally developed in 1976 for use in- 
second grade in the CSMP Extended Pilot Test. Like all MANS scales they were 
intended to assess important mathematical'thinking skills thought to underlie 
the CSMP curriculum, but in a novel context where possible and without using 
any of the special terminology and techniques of the CSMP curriculum. They 
required extensive directions and explanations, given in a standardized manner 
by specially trained testers. They were administered to 70 second grade' 
. classes, some CSMP and some non-CSMP classes, and the results of this experi- 
mental comparison are given, in Evaluation Report 3-B-l. 

because of the expense ahd effort required to train testers, these scales 
have had 1 imi ted, utjl ity outside the realm of CSMP Evaluation activities. In 
order to make them more widely available, these scales were revised in 1979-80. - 
The primary objective was to simplify the di recti ons -enough that a local coordinator 
could fairly 'easiTy train a tester to carry,out the testing. (Other revisions 
were also made based on statistical data from the original study and on new scales 
developed later in higher grades, but appropriate in concept for use with second 
graders.) These revised scales were denoted as the "Blue" Level, intended for ■ 
second graders, but appropriate for certain first and third grade classes as well. 
Tliejj,ue Level .MANS consists of 13 scales. 10. of which are of the usual MANS 
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variety described above. Three of the scales /standard computation, place value ♦ 
and word problems) are not particularly novel and resemble sections of traditional 
tests of sthool achievement. 

In the Spring of 1980 th^MANS Blue Level t^s administered to 21 second grade 
cTasses in three school districts and the results are given in Evaluation' Report 
7-B-4. One shortcoming of that study was the under-representation of classes 
which were lower than average in ability, as measured by reading comprehension 
scores. ^ 

In 1980-81 there was an opportunity to make further (minor) revisions in 

the MANS^Blue Level and to administer it to a set of classes, thetmajority of which 

) 

were of below average ability. This report presents the results of these efforts. 

The present report serves an additional purpose. After the completion of 
the Extended Pilot Test for the second grade curriculum, final revisions, were made 
in the curricurbm, as -tir the case with other grade levels. Thus it is possible 
to view this report^^'Srvd Evaluation Reptirt 7-B-4 as ^ fairly complete assessment 
of student achievement a\ the end of second grade with the revised CSMP curricu-lum. 
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Revision of the MANS Blue Level 

The revision of the MANS Blue Level consisted primarily of completing the 
package of testing materials to be sent to a local testing coordinator. > coordi- 
nator's manual was constructed to enable a local school administrator to select 
and train testers, schedule testing sessions, etc. Within the test booklets 
'themselves, the Gates-McGinitie Vocabulary Test, Level B Form 1, was, added in order 
to provide a uniform measure of general ability." It was divided into two equivalent 
halves, each taken by half the. students in a class, thereby providing a- reliable * 
estimate of the class^mean score on the total Vocabulary test. , 

A secondary aspect of the MANS Blue Level revision involved minor changes 
in the student pages and tester instructions- of the MANS scales themselves. From 
the analysis^of the results from the. administration of the initial version of 
^ the MANS Blue Level, several different things were taken into account: item 

• difficulties, item biserials (with respect to its scale and the covariate), 
numbers attempting the items, frequency distributions on total score on scales, 

• KR20 correlations, correlations between scales and the covariate, eiquality between 
.two forms of a scale, .etc. ' . 

Of the 160 items, 136 were i^etained in 1981 exactly as they were in 1980, 
14 were revised slightly and 'lO were dropped while 11 more were added. The item 
revisions and changes were made to correct errors in test construction, to increase 
a scale's range of difficulty level, or to increase or decrease the general difficulty 
level of a scale. On balance these item revisions and changes may have made the. 
total test slightly harder. Some 30 of the retained items were switched from one 
• form to the other in order to balance the diffi^culty level of the two forms. No " , 
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new scales were added and none of the 13 old ones was eliminated. 'Tester in- 
striictions were revised slightly in order to reduce instruction time or to 
decrease the probability of -misunderstanding. 

The thirteen scales in the MANS Blue Level have been grouped into seven, 
categories, described in the table below. 

Table 1 

Description of Scale Cateaories^ 



Scale Category 


Description 


No. of Scales' 


Computation 
• 


Includes two types of scales: 
standard computation taken or 
adapted from computation subtests 
of standard aphievement test 
batteries, and mental arithemetic 
requiring the* exait ansvfer^ to 
v.alculations^ynenable to non- 
algorythmic '^lution. 


2 

\ 


Estimation 


Requires the rapid deriving of. 
approximate answers to problems., . 


3 


Fluency 


Requires producing many correct 
answers to a given problem.^ 

> 


1 


other Number Sy;s terns 


Requires computation with, or 
applications of, negative numbers, 
fractions and -decimals depending 
on grade level : 


1 


Number Patterns and Relationships 


Requires finding or applying a 
given pattern in sets of numbers. 


4 


Place Value 


Requires an understanding of the 
base ten numbering system. 


1 ■ r 


Word Problems 

\ 


Requires* tlie solution of types of 
word problems not usually 
encountered at the grade level* 


1 


TOTAL 
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For descriptions of the scales themselves, see the section of this report titled 
Results of the Testing. / 
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Setting of the Test Administrations 



^ The revised Blue Level of the MANS test was administered to forty second 

grade classes in five school districts. Specific information about each of these 
sites is given in table 2. » 
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Table 2 

Description of Testing Sites 





Site 
Three 


Site 
Four 


Site 
Five 


S1t£ 

Six 


sue 
, Eight 


Section of the Ccfuntry 


South 


South 


Midwest 


Ml dwest 


Hi dwest 


Type of Community 

} 


i ' 

Large 
City 


Small Town 
and Rural 


Suburb 


Small ' 
City 


Large 
City " 


Socio Economic Background 


Low 


Low to 
Middle 


Middle 


Middle 


Lov; 


Number of Classes: CSHP 


S 


■ ■ 1 


2 


2 


10 


Non-CSHP 


4 


1 


3 




10 


* ' C 
Average No. of Students: CSMP 

Classes 


27 


40'' 


23 


17 


24 


Non-CSf«> 
Classes 


26 


38^ 


25 


19 


25 


Mean Vocabulary Score^: CSMP 


_ 21.3 


29.1 


33.6 


38.7^ 


22.8 


Non-CSMP 


21.1 


26.0 


28.4 


41.3^ 


23.7 



0 



in SI^lltHct " '° ' ""'l^ °^ students from several different Classes 

respSlwlJ*' student?, scores of 21, 29. and 37 correspond to the 25th. 50th and 75th percentile: 
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^/n this site, classes were cornposed of upper track students. 

7 
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" Overall, there were an equal numtjer of DSMP and non-CSMP classes (20), 
involving slightly^ more than 500 students in each group. The mean across classes 
on the vocabulary, test v4as 25.4 for CSMP and 25.8 for non-CSMP. The majority of 
the teachers were teachir^g CSMP for the first time, most of 'the remainder for 
the second. The majority of the students had been in OSMP since at least first 
■grade; ;^few had just started in tecond. 
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Feedback on the Revisions 

. * * * 

' Local Administration 

•The primary objective in the revisions was to enable local school administrators 
to use the MANS tests without direct outside assistance. This objective appears 
•to have been met and, at two. of the sites a member of the CSMP staff ob'^erved the 
local coordinato^rs using the various materials to train testers. Both times this ' 
•process went smoothly. It seems safe to assume that the majority of school systems 
would be able to use the MANS Blue Level in its present form. 

Quality of the Scales • ^ 

The secondary objective .in the revisions was to upgrade the quality of the 
scales. Each of the scales was analyzed from several points of view, only three 
of which will be reported in this section: internal consistency, ceiling effect 
and floor effort. Internal consistency was measured using the KR20 reliability 
coefficient corrected with the Spearman-Brown Formula, for increasing the number 
^of items to a common number, ,12, for each scale. Table 3, below, the corrected 
^20 i? given for each of the scales for 1980 and 1981. 

9 
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Table 3 

Corrected KR20 Reliability on MANS Scales 


• 


1980 vs. 1981 






i . 
w 


1980 Corrected KR20 


1981 Corrected KR20 


1 

HANS Scales' 


Form 1 Form 2 


Form 1 


Form 2 


Which Is Larger 


.65 


.56 


.44 


.51 


Negative Numbers* 


.75 ' 


.50 \ 


.78 


.69 


Labelling Number Lines 


. /D 


. oU 


.89 


. .80- 


Writing Number 


.87 


.85 


. 00 


« oO 


Coinputati on 


.77 


.77 


.78 


.82 


Sequences 


.92 


.91 


" .91 


.90 ■ 


Solving Number Machines 


.80 


.88 ■ 


.88 


.84 


Mental Arithmetic 


.80 


.85 


.81 


.81 


One-Step Word Problems 


.792 






.76^ 


Estimating Intervals + 


.74 






.61 


Estimating Intervals - 


.64 






.54 


Estimating Intervals x 


• .63 






.58 



Table 3 shows that the majority of the scales were in the acceptable .70 to .90 
range. It is noteworthy that the five scales with the lowest KR20's are the ^ 
five which have the multiple choice response format, giving rise to much guessing 
with low ability students. Table 3 also shows a striking similarity between the 
1980 and 1981 results. Some of the differences may be explained by changes made 
in the scales. Form 1 of the Solving Number Machines Scale was changed by correcting 
an item inadvertantly made practically impossible in 1980. Form 2 of the Negative 



The Number Fluency scale Is not composed of a set nurrber of items and therefore did not yield 
a reliability coefficient. 

2 

For the last four scales there was only one form. 
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Numbers scale was changed by reducing the number of items that could be answered 
correctly using a popular (but incorrect) line of reasoning. Form 1 of the 
Labelling Number Lines scale was changed in a number of respects but none that ^ 
would explain the increase in the KR20. For four of the scales (Which Is Larger 
and the three Estimating Intervals scales), not only did the KR20 stay below the 
acceptable range, but in each, case it actually dropped from 19.80 to 1981. Perhaps 
this was due to the fact that they all involve items of the multiple choice variety 
and the general ability level of the 1981 student population was much lower than 
that of 1980. 
O 

In order to determine the possibli'ty of a ceiling effect or a floor effect, 

a frequency distribution of student total scores was made for each scale. Table 

<i 

4 gives the relevant results from those distributions. 
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Table 4 

Percentage Scoring 0% or 100% for each MANS Scale 



^WNS Scales^ 


No. of 


Percentage Scoring OS 


Percentage Scoring lOOX 


Items 


i-om 1 


Form 2 


Form 1 




Form 2 


Which Is Larger ^ 


9 


7 


0 4 


0 




0 


^ Negative Numbers 


4 


48 


15 


5 




8 


Labelling Number Lines 


5 


33 


31 


8 




0 


•Writing Numbers 


n 


13 


7 


8 


■ • 


8 


Computation 


9 


3 


5 


9 




7 


Secuences * 


c 
9 


25 


38 


17 




1>J. 


Solving Number Machines 


4. 


46 


'55 


9 




6 


Mental Arithmetic 


12 


6 


12 


1 




0 


One-Step Word" Problems 


9 ■ 


62 










Estimating Intervals + 


7 


11 






0 




Estimating Intervals - 


6 


16 






1 




Estimating Intervals x. 


5 


23 






1 





Taking into consideration the number items per scale and the fact that 
4 of the 40 classes were of very high ability, Table 4 shows little evidence of 
ceiling effect. However in the case of five- scales (Negative Numbers, Labelling 
Number lines. Sequences, Solving Number Mach-ines, .and Estimating Intervals x) 
Table 4 does -show evidence for a floor-effect. Nevertheless it* is interesting to 
note that these five scales are also the five with the fewest number of items. In 
addition the reader is reminded that 34% of the students scored in the Ipwest 
quartile on the vocabulary test. ' / 



^The Hunter Fluency scale Is not composed of a set number of Items and therefore did not yield 
a reliability coefficient. 

^For the last four scales there was only one form. 
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Results of the Testing 

The MANS Scales and Summary Statistics Across Classes - • 

In the next few pages, the scales are listed by, category. Preceding the 
name of each scale is a letter and number in parentheses: the letter referring 
to the category and the number distinguishing between scales in that cat^ory. 
For each scale there is a brief description and a sample item. Also given are the 
number of items per fomi and some of the time limits. For a few scales /all 
students took tl?e same form. But for most scales (those indicated by "x items, 
two for^Bi::), each student took one of the two forms» For most scales, a flexible 
and sufficient amount of time was allowed. For a few scales, dealing with problems 
meant to be done without exact calculation, strict time limits- were adhered to; 
for these particular scales, the allowed time has be.en shown. 

The following procedure of analysis was used for each MANS scale. Individual 
students who did not have both a score on the scale and a vocabulary score were' 
eliminated from the study (us^ually less than one per class). For the remaining 
students in each of the classes, twavmean scores were calculated: on the MANS 
scale and on the vocabul-ary -test. (Where a MANS scale had two forms; the mean 
% for that scale was the sum of the means of the^ two forms.) An analysis of covariance 
procedure was then used with class means 'as the unit of analysis and vocabulary 
as the covariate. 

Therefore, beside each, scale description are three statistics. The first two 
are the adjusted mean for the 20 CSMP classes and the adjusted mean for the 20 non- 
CSMP classes, adjusted to take into account differences in ability, ba'sed on scores 
from the Gates-McGinitie Vocabulary Test, Level B, Form 1. The mean scores on this 
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vocabulary test were almost iden1;ical: 25.4 for CSMP classes and 25.8 for non- 
CSMP classes. Hence the adjustment in the MANS scores was very sm'al'l - less 
than 1% tadjusted upward for CSMP and downward for nop-CSMP). The third statisti 
is the p-value of the resultfng t-test: that is, the probability of such a 
difference in means occurring by chance if one assumes "no difference" be^tween 
the two groups of classes. If the probability is small (less than .05) then the 
difference is traditionally called "statistically significant", the imp-lication 
being that there is_ a difference between the two groups of classes. 
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(C) COMPUTATION 



(CI ) Coirfputation • 

Abstract: JJ^ms patterned after those ih arithmetic computa- 
' 2nd Grade ^''^ standard achievement tests for 

(9 items (using +,-.x). 2 forms) 



Examples:. 



19 



49 



5x8 = 



Adjusted Means p-val 
CSMP non-CSMP 



10.3 10.7 



.53 



(C2) Mental Arithmetic 



Abstract: 



$ Examples: 



Put the number in the box which makes the number 

ea's^^J io?k w^th *^^-1"-bers are large and 
(12 items (using +.-,x). 2 fohn^.) 



□ +70« 90 

600 - 100 - I I 
3 X □ = 300 
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* ■ , - . (E) ESTIMATION 

(E2-E4) Estimating Intervals 

Abstract: Gi\(^n a computation problem, and 5 fixed 
•intervals (0-10, 10-50, 50-100. 100-500. 
500-1000), determine which interval contains 
we answer to the problem and put an x 
in the interval. By instruction, format and 
time limits, students are discouraged from 
computing exact answers. 

Examples: 

Estimating Intervals - Addition 

51*53 0 10 • so 100 SCO 

(7 items, on form, time limit: 1% minutes) 

(E3) Estimating Intervals - Subtraction 

900- 601 0, 10 JO 100 500 
(6 Items, one form, time limit: 1J$ minutes) 

W Estimating Intervals - Multiplication 

Sx'n 0 10 so 100 500 

(5 Items, one form, time limit: 1% minutes) 

15 



tooc 



lOOO 



1 000 



2 



9.8 8.1 



,02 



2.8 



2.7 



.39 



1.9 



1.8 



.58 



1.5 



1.3 



.04 



\ 



(F) FLUENCY . Adjusted Means p-val • 

. * CSMP non-CSMP 

(Fl) Number Fluency r g 5 5 3 

^ Abstract: Given sample number sentences about 9 (9 = 10 - 1, 
9 = 1 + 5 + 3, 9 =^3 X 3, 9 = 18f 2) make up, as 
many number sentences as you. can about 8. 
' (Open ended, but a maximum of 16 were counted, 
1 form, time limit = 4 minutes) 

Exampl e : ■ . * 
My number sentences • about 8. 
8 8 - 



8 - . 8 

8 • 8 



(N) OTHER NUMBER SYSTEMS 

(Nl) Negative Numbers ' 2.8 2.4 JO 

Abstract: Given the starting score (which coufd be above or 

below zero), and how much the score went up or down^^ 

determine the final score. / 

(4 items, two forms). » ' ^ 

Example: 

ftiv«2 Scort *t tht JUrt: $ btlow nro 
Tr>«i: Uoft 2 

Scort »t tht tnd? 7 b«1ow xtro 3 btlow xtro 3 tbovt xtro, 7 ibovt itro \ 
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(R) NUMBER REUTIONS 



(Rl) Solyln. Nu^er Machines C^* *^„S 

Abstract: From 3 pairs of numbers (clues), determine what. 2 5 i Q oi 

the person's game is (i.e. how the second number 
J is derived from the first). Then use this know- 

ledge to find the missing number from the 4th , 
pair. 

(4 items, two forms) 
Example:- otvid's Ga»t J 

I 

Cl«s Oivtd's 

^ J Slid: tnswer: * ^ 

First clut: 5 10 

S«cond clu« 1 2 . 
I Third Clue: 3 6 

Qutstlon: 4 ^ | ^ [ 

(R3) Sequences 4.3 3,8 .07 

• Abstract: Determine the missing number in a given sequence 
of numbers. 
(5 items, two forms) 

Example: 

28. 25. 16. 13 

^ • * 

(R4) Which Is Larger? ^ 6.7 6.7 .78 

Abstract: Given two. similar computation problems choose the 
one which gives the larger answer. By instruction, 
format and time limits, students- are discouraged 
from computing exact answers. The larger answer 
could always be determined more easily by in- 
spection than, by doing the "computation. 
(9 items (using +,-,x), 2 forms, time limit « 
3 minutes) 

Example: sas * 250 ' ["] 

. (Check the larger one) . 

580 + 290 Q 

(R5) Labelling' Number Lines 3^8 2.7 .01 

Abstract: Given a number line with some of the marks labelled, 
use thft pattern shown to fill in the Indicated 
blank with a label. A sample was worked 
collectively. 



(5 items, 2 forms) 



Example: 



EMC .17 9 



(V) PLACE VALUE 

(V3) Mdtf >a Numben * 

Abstract: a) Write a number that is read aloud. 
(6 items, one. form) 
b) Given a number, determine what number is 
1, 10 or 100 larger or smaller than the 
given number. A sample item- was worked 
collectively. 
(5 items, 2 forms) 

Ex^ple: 

What number is 10 more than 402? 



Adjusted Means p-value 
CSMP non-CSMP 

i 

11.3 10.1 .07 



<W) WORD PROBLEMS 



(Wl) One-step Word Problems 

Abstract: As the student looks at a series of cartoons and 
' and/or follows the story in the captions below, 
the story is read by the tester. 
(9 iteifjs, 1 form) 

Example: 



How Mny btnanai did 
sh« buy? 




J111 spoit ti to 
buy toM binwat 



laiitMt cost 2( lach. 



3.9 3.7 



.28 
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Summary of CSMP/non-CSMP Comparisons by MANS Category 

The, 13 individual MANS scales were grouped into 7 categories according to 
the content of the scale. Table 5 shows the adjusted means and p-value for each 
of these categories. 

'\ , ■ Table 5 



S 



MANS Results by Scale Category 



Scale Category^ 
(specific scales) 


Number 

of 
Items 


AdjusteS^an Scores 


p-Value 


CSHP Classes 
■■( n=20 ) 


Non-CSHP Classes 
( n=20 ) ■ 


Computation (CI , C2) 


42 


20.2 


18.8 


.22 


Estimation (E2, E3, E4) 


18 


6.3 


5.9 


.22 


Fluency (Fl)^ 

V 


16 


6.5. 


5.8 


.16 


Other Nuiriber Systems (Nl) 










(Negative Numbers) 


8 


2.8 


2.4 


.09 


Number Patterns and 










Relationships (Rl, R3. R4, R5) 


46 


17.5 


15.1 


.01 


Place Value (V3) 


22 


11.3 


10.1 


.07 • 


Word Problems (Wl) 


9 


3.9 


3.7 


.28 


■ TOTAL SCORE: 


161 


68.5 


61.7 


.03 



Appendix A gives the means on each subtest for each class in the study. 



table 5 shows that the difference between the CSMP and non-CSMP classes on 
t^ie total MANS test was statistically significant in favor of CSMP. Further it 
shows that there was a difference in favor of CSMP in each of the seven categories 
but that only for -Number Patterns and Relationships was it statistTcal ly 
significant (at the .01 level). 
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Comparis-on with Previous ^S tudies . ■ ' " 

The most closely related study (Evaluation Report 7-B-4) tested 21 second grade 

classes, 12 CSMP and 9 non-CSMP. .Table'' 6 gives a comparison of the CSMP/non-CSMP 

results in the two studies. 

. ) - _ ^^^^^ g 



Comparison of Present Results with those of 1980 



1 



" -1981 Scales 


, jSimiiar 1980 Scales 


Hatne 


p-Value 


P'Value 


Labell ing Nuroer Lines 


.001 


' .01 


Solving Nurrber 'Machines 


.01 


.di 


iMental Arithmetic 


.02 . 


.05 


Estimating Intervals: x 


..04 ^. 


.01 


Writing Numbers 


.07 


.01 


Sequences 


.07 


.05 


Negative Nuirbers 


* .10 


.10 


Nunber Fluency 


.17 


.01 


One Step Word j^blams 


.28 


.20 


Estimating Intervals: ^ ^ 


.39 


.40 


Estimating Intervals: - 


.58 


.10 


Which Is Larger^ 


.78 


.10 


Computation 




@2 



See Evaluation Report; 7-8-4. 

2 

The circle denotes that the difference was In favor of non-CSW. 

Table 5 shows that the differences in favor of CSMP were generally somewhat , 
stronger in the 1980 study, but that the pattern of strengths and weakness is very 
similar. Scales showing a statistically significant difference in favor of CSMP 
in 1981 generally 'showed similar results in 1980. Where the .difference in favor 
of CSMP was smallest in 1981, it was alsoO'eladvely small in 1980. The one , 
scale (Computation) in which the difference was slightly in favor of non-CSMP in 
1981 showed a similar result in 1980. 
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Graph of Class Means •>. 

In Figure 1 a graph is pr^'sented in which each class is represented by its 
me'an on the vocabulary test and its mean on the total MANS score. Als^'^hown 
js the regression lin^ based on the present data. It shows the bes/estimate of 
a class mean on the Total MANS test given the mean on the vocabulifry test. 
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•Figure 1, Class Means, Total MANS Score vs. Vocabulary 

Figure 1 shows the preponderance of classes with rather low vocabulary scores. 
In fact 30 of the 40 classes scored below 29 which is the 59th percentile on the 
national norms for individuals taking that section of the Gates McGinitie Test. 
The graph also shows that the classes which had the highest MANS scores relative to 
reading ability were all CSMP classes, but that several CSMP classes were also among the 
lowest scoring classes. By contrast, the non-CSMP scores were much more regular 
in the sense of being within a fairly narrow band relative to the regression line. 
Appendix A gives the mean on each MANS scale for each class in the study. 
'-■ • , 21 



4 

Graph of District Means' 

Figure 2, below, has been constructed in a fashion similar to Figure 1 except 
that district means are plotted instead of class means. 
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Figure 2, District Means, Total MANS Scores vs. Vocabulary 



Figure 2 shows that each district occupies a rather distinct position in the 
range of vocabulai-y scores. In addition it shows that CSMP classes out-performed 
their non-CSMP counterparts in each district. 
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APPENDIX A 
LIST OF CLASS MEANS 
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Table 7, below, gives the mean on each MANS' scale for each of the 40 classes 
in this study. The classes with numbers 1 - 10 are CSMP classes, those larger 
than 10 are non-CSMP. The scale designations (a letter and a number) are keyed 
to those that appear with the scale names and descrfptions throughout this report. 



Table 7 

List of Class Means, Second Grade MANS Tests, 1981 



0t3T CLASS COrtPUTATIOII 



1 
2 

% 

5 



SI 
92 

-9S- 



Cl- 

15. «• 
l^.t 



^.^ 

S.7 

10. s 

s.^ 

7.2 
%.7 

n,3~ 



rSTIflATlOM 

— -Zt- <5 

2.H l.S 
2.9 1.9 1.6 

— «•» — ti^ 

i.r 1.1 i.« 

3.1 1.7 1.2 
- f » — V. % - »— 
1.4 1.3 l.« 
1.9 1.0 

— »l« 1^*— »»T^- — 




«Nn ncLATXorjSMirs 

M R»— — 



1*7 3«% %.9 

1.7 2^3 fi.4 

i,ti — 

2.2 3.« 

1.% 2*3 S.» 
4«4^«9 — W*- 

2.1 3«3- Si% 

1.9 1.3 %.0 



1.7 




TOTAL 



92.1 
*9.9 

93,9 — 

^3.1 

9<.9 
37, C 



VOCAeL 

21.7 
21.1 
-20 4^- — 

20. % 
22.9 

21, # ' 
29.9 
19. & 



til.ft - -lit* 



2.4 1.3 




2.3 1.9 l.« 
1.6 1.7 l.H 
*T^»tf7 — 
3.D 1.7 1.3 
P.f> 1.4 1.3 

— W*- 

3.0 2.1 1.4 
1.9 0.9 

?.) 1.9 1.1 
2.« 1.9 1.3 

— 

1.9 1.1 g.7 
2.n 1.1 l.H 

-etf — itT— 4«*- 
2.n 2.» 1.1 
2.P 1.9 1.2 
-«.l — — 



*».7 



2«0 



1.4 3.9 4.9 3.3 12.9 



e,7 



4.2 

3.a 



9.3 

3.n 



9.* 



-Z^ — 1^ 



9.0 
4.7 



4.3 



7.0 
7.4 



3.3 

^2.3 



3.% 

2.3 



4.3 
1.9 



7.t 
4.% 



1.1 
3.4 



19.1 
1%.2 



12.1 
It.l 



— 1.1- 
1.2 



^71.2 - 29,1 
43.1 24.9 



9.7 
1.9 



1.9 
1.1 



99,7 * 39,5 
63«2 31.7 
45. t^-. 2I<} 
7^.3 29.2 
42«l 27.9 



2.3 


10.4 

VO^il 


3.9 
S»9 


1.^ 

tT*r 


4.1 


1.9 


4.1 


14.9 
—3^^ 


9.1 

1^ 


95.9 

iaa,7 — 


31. « 

39.»— 
11. » 
It, 7 


— 

2.1 

a. 3 


ir.9 

10. • 


1.2 

i.a 


9.2 
l.t 


7.1 

7.1 


9.1 

9.3 


4.7 
9.4 


lt.7 

1«.2 


4.9 
4.7 


11^.2 
. 101.1 



9.0 



9.3 
9.2 

7.0 
».9 



4.2 

3.2 

(.1 



1.9 

9.3 

4.1 

1.7 

-»,1.. 



2.T 
-W7- 

2.1 

U9 
-#t9- 
.1.1 

2.2 



2.3 



9.4 1.1 
a, 4 7 .V 



2.3 
1.1 



3.0 
2.2 



3.7 4.2 
1.1 4.3 

-♦r4 — 



9.2 



2.7 
1.1 



13.4 

10.1 
10. 9 



1.2 4.3 
2.9 4.1 
1,1 



l.ft 
2.6 



13.7 
11^6 
» , 7 - 



2.2 
2.f 

-4.7- 
2.0 
2.2 



1.9 
1.9 



1.1 



2.9 
2.1 

1.4 
1.9 



1.6 
2.9 



1.0 7.1 

1*3 9a 

1.9 4.3 
2.7 4.4 

.4,^4— ^r4- 



2.4 7.1 
1.3 4.1 

-^t — 4t»- 



3.« 
2.9 

3.4 
1.9 
4^»> 



1.9 
1.9 



1.9 4.1 
i.l 4.0 
■ 2, 9 4^a- 



K.2 
2.1 
-V,4- 
2.9 
1.2 
1.4 



10.9 
3.2 
— ^»0- 

12.0 
1.1 

4.3 
9.9 

— ♦,9- 
9.9 
7.4 

— 6*4 - 



1.3 

3.3 
3.0 

-4^7- 
1.3 
3.9 

-4^t^ 
1.7 
2.9 

-4r*' 
1.1 
2.8 



1.1 
1.0 

3.3 
2.4 



01.9 

%2.4 

43.1 
43«S 

42.1' 

74,9 
41.4 

4».9^ 

46.3 
^ 32.1 

52,4- 

49.3 
99.1 

79.4 

91.1 
41.2 

fl.9- 

41.9 
19.S 

01,7 



22.0 

- 29*0> 
24.4 
20.2 

.«I9.»>- 
22.1 
20.2 

- 22,%- 
20.7 
14.7 

21.0 
11.9 

.-41,%- 
21.9 
23.1 

— 20«^ ' 
23.1 
tl.l 

- 2t,4 
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